CMMD I/O: A Parallel Unix I/O
نویسندگان
چکیده
We have proposed a library providing Unix file system support for highly parallel distributed-memory computers. CMMD I/O supports Unix I/O commands on the CM-5 supercomputer. The overall objective of the library is to provide the node level (SPMD) parallel programmer with routines for opening, reading, writing a file, and so forth. The default behavior mimics standard Unix running on each node; individual nodes can independently perform file system operations. New extensions to the standard Unix file descriptor semantics provide for cooperative parallel I/O. New functions provide access to very large (multi-gigabyte) files.
منابع مشابه
MPI-IO: A Standard, Portable API for High-Performance Parallel I/O
MPI-IO, the I/O part of the MPI-2 standard, is a portable API for high-performance parallel I/O. It is speci cally designed to overcome the performance and portability limitations of the Unix-like APIs currently supported by most parallel le systems. We discuss the main features of MPI-IO and describe our MPI-IO implementation, ROMIO, which runs on most machines and le systems, including Linux ...
متن کاملLow-level Interfaces for High-level Parallel I/o
As the I/O needs of parallel scienti c applications increase, le systems for multiprocessors are being designed to provide applications with parallel access to multiple disks. Many parallel le systems present applications with a conventional Unix-like interface that allows the application to access multiple disks transparently. By tracing all the activity of a parallel le system in a production...
متن کاملUser-Level Parallel File I/O
Parallel disk I/O subsystems are becoming more important in today’s large-scale parallel machines. Parallel disk systems provide a significant boost in I/O performance reducing the gap between processor and disk speeds. We describe a Unix-like file I/O user interface, implemented in a parallel file I/O subsystem on an MIMD machine, the nCUBE 2. Based on message passing, we develop parallel disk...
متن کاملI/O in Parallel Applications: the Weakest Link
Parallel computers are increasingly being used to run large-scale applications that also have huge I/O requirements. However, many applications obtain poor I/O performance on modern parallel machines. This special issue of IJSA contains papers that describe the I/O requirements and the techniques used to perform I/O in real parallel applications. We rst explain how the I/O application program i...
متن کاملDPFS: A Data-Parallel File System Environment
Most parallel I/O systems allow parallel accesses to sequential les. The DPFS is a multi-dimensional le system. Each le is a list of arrays distributed onto a grid of I/O processors as template onto HPF processor grids. I/O node topologies and distribution functions are placed at the device level. This means that le distribution only depend on their directory location. By using distributed para...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1993